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Abstract 

The aim of this paper is twofold: first of ah, we show that the limit of 
a pair of commuting Hamiltonians commute. This means on one hand that 
if the limit of the Hamiltonians is smooth, the Poisson bracket of their limit 
still vanishes, and on the other hand that we may define "commutation" for 

functions. 

The second part of the paper deals with solving "multi-time" Hamilton- 
Jacobi equations using variational solutions. This extends the work of Barles 
and Tourin in the viscosity case to include the case of Hamiltonians, and 
removes their convexity assumption, provided we are in the framework of 
"variational solutions" . 
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Hamilton's variation principle can be shown to correspond 
to Fermat's Principle for a wave propagation in 
configuration space (g-space), and the Hamilton- Jacobi 
equation expresses Huygens' Principle for this wave 
propagation. Unfortunately this powerful and momentous 
conception of Hamilton, is deprived, in most modern 
reproductions, of its beautiful raiment as a superfluous 
accessory, in favour of a more colourless representation of 
the analytical correspondence. 

E. Schrddinger, Quantization as a Problem of eigenvalues 
(Part H), Annalen der Physik, 1926 
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1 Introduction 



The problem of finding solutions of multi-time Hamilton- Jacobi equations, by which 
one usually means equations of the following type, where x is in M" and tj in M 



^u{ti, . . .,td,x)+ Hiiti, ...,td,x, ^u(ti, . . . ,td,x)) = 



(MHJ) 



Q^u{ti, . . . , td, x)+ Hdih, . . . , trf, x, -g^u{ti, ...,td,x)) = 
with initial condition 

m(0,...,0,x) = /(x) 

has been initiated by Rochet in relation with some questions in economy, then 
by Lions-Rochet and studied more recently by Barles-Tourin and Motta-Rampaz- 
zo ( IRochetj [L ions-Rochet[ IBarles-Tourinl |Motta-Rampazzo| ) . Such a system of 



equations is well-known to be overdetermined, and in order to have a solution, we 
need the Hamiltonians to commute in a suitable sense. This is already obvious when 
applying the method of characteristics. Besides a suitable commutation condition, 
we need to address the question of the type of solution one is looking for. For 
first order equations, it is well known, and was proved for more general equations 
by Dacorogna and Marcellini Dacorogna-Marcellini| , that there are plenty of 



solutions for such equation^. We then need to select a particular "class" of solution, 
deemed to be the best suited to our problem. A classical choice is to look for viscosity 
solutions, which are the "right" solutions for optimal control and this is the type of 
solution considered in the above papers (except for [Dacorogna-Marcellini] ) . 

In Barles and Tourin's paper, the existence of a viscosity solution is proved under 
the assumption that one of the Hamiltonians is coercive with controlled growtlj^ 

(see [Barles-Tourin] . page 1526, conditions (H1),(H2)), and more importantly 
that Hi , H2 satisfy the following conditions 

(a) , independent of (ti,...,^^) 

(b) . convex in p 

(c) . of class and satisfying the commuting condition {Hj,Hk} = 



"'^By C*^ solution we mean almost everywhere, and satisfying the equation a.e. 
^Condition {HI) in [Barles- Tourinj states that for each R there exists Kn such that 
\Hi{x,p)\ < Kr and \^[x,p)\ < Kr(1 + |a;|) in M" x B{0,R). Moreover the authors assume 

duQ{x) to be bounded. These conditions are stronger than the assumptions we need here. See 

appendix |B] for more details. 
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In fact the third condition can be weakened, as Barles and Tourin point out, to 
assume that the Hj are C° and there are sequences of Hamiltonians of class 
such that 

(a) , hm^^oo -f^j' = Hj in the C° topology 

(b) . {/7;,i7r} = o 

In other words, the Hj are limits of commuting Hamiltonians. 

However such an assumption is quite unpractical since it is already difficult to 
write two commuting Hamiltonians as nontrivial limits of commuting Hamilto- 
nians. 

The present paper has several goals. 

First we solve the multi-time Hamilton- Jacobi equation in the framework of 
"variational solutions" defined by Sikorav, Chaperon and the second author in 
[Sikorav l] Chaperon Viterbo-Ottolenghi] (see definition 12. II) . According to a result 



by Zhukovskaia (cf |Zhukovskaya| ), if the Hamiltonian is convex in p, the variational 
solution must coincide with the viscosity solution defined by Crandall and Lions (in 
[Crandall- Lions] . see also our definition 12. lip , so that our results extend those of 
Barles and Tourin. However in general these two solutions do not coincide (see an 
example in [Viterbo^ ). For variational solutions, we prove that we only need the 



Hj to be C , and condition (b) is then replaced by a "commutation" condition best 



expressed in terms of symplectic invariants, refining the following 

Definition 1.1. Let H,K be two autonomous C° Hamiltonians. We shall say that 
H and K C°-commute, if and only if there are sequences if,^, of Hamilto- 
nians such that, all limits being for the C° topology, we have: 

(a) , limj^^oo = H, limj^^oo K,, = K. 

(b) . \im,^^{H„K} = 0. 

A similar definition is given in section 3 for H, K time-dependent and in appendix 
[Cl for the case of equations depending on the function. 

Postponing to the next Section the detailed geometrical setting for our Hamil- 
tonians, the two main theorems of this paper are: 

Theorem 1.2. If two C^'^ Hamiltonians C°-commute, then they commute in the 
usual sense (i.e. their Poisson bracket vanishes). 
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Here C^'^ means differentiable with Lipschitz differential in the variables {x,p). 
The above theorem tells us that our definition of C°-commutation coincides with 
the classical one for smooth Hamiltonians. Note that this may be extended to the 
time-dependent setting as we shall see in section 13.11 

The above theorem sounds like a generalization of Eliashberg-Gromov's theorem 
( [Gromov] , [Eliashberg , [Ekeland- Hof er ] ) on the closure of the group of sym- 



plectic diffeomorphism, according to which the set of 2n-tuples of functions on M^", 
(/i, /„,5fi, ...,5f„) such that 

{fi, fj} = {9i,9j} = 0, {fi,gj} = 51 

is closecH. We refer to [Humiliere 2j for an approach along these lines of the Gromov- 
Eliashberg theorem. We also refer to improvemets of the above result from a quan- 
titative point of view due to [Entov-Polterovich-Zapolsky] using quasi-states. 

This has been extended by V. Humiliere to other relations derived from so-called 
quasi-representations of finite dimensional Lie groups in the Poisson algebra. For 
example the Heisenberg relation {/,(?} = h; {f,h} = {g,h} = is also C° closed 
(see [Humiliere 2] ). 

Theorem 1.3. Assume the Hamiltonians Hi{ti, ..,td,x,p), Hd{ti, ..,td,x,p) on 
TM") satisfy the following conditions 

(a) , they are locally Lipschitz in {x,p) and their Lipschitz constant on the ball of 

radius r has at most linear growth in r. 

(h). their support has an x-projection contained in a compact set. 
(c). They C°-commute. 

Then equation (MHJ) has a unique solution which is a variational solution of each 
individual equation. If all the Hamiltonians Hj 's are convex inp, then u is a viscosity 
solution of each individual equation. 

Remarks 1.4. (a). We refer to definition l2.1l and l2.111 for the meaning of variational 
and viscosity solution. 

(b) . The growth condition is only needed to guarantee the existence of the flow 

for the approximating Hamiltonians. Since if dH has linear growth, we may 
approximate it by smooth Hamiltonians such that the vector field X^'^ is 



■^To be rigorous, Gromov and Eliashberg need the map {x, y) 
{fi{x, y),-; fn{x, y), gi{x, y), gn{x, y)) to be bijective. 
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complet^, this condition is sufficient. In fact, it is enough to assume there are 
constants y4, 5 such that < + + 5, i.e. the Lipschitz norm 

of on a ball grows at most linearly with the radius. Note also that in some 
cases, we may guarantee existence of the flow of the Xh^ for other reasons. 
For example when H is autonomous, and proper, since the if^ will satisfy the 
same assumption, and conservation of energy implies that the flow remains in 
a compact set, the flow of Xh is thus defined for all times. 

Remark 1.5. The paper is not supposed to be written for specialists in symplectic 
topology, although a certain familiarity with the basic constructions of [ViterboT] 
and |Viterbo-Ottolenghi| is recommended. Appendices A and B are of a more sym- 
plectic flavor and really address the question of Hamilton- Jacobi equations from a 
symplectic topology viewpoint. In particular Appendix [B] addresses the question of 
the growth conditions one must impose on the Hamiltonian and the initial condition 
from a purely geometric point of view, while Appendix O extends the main theorem 
for equations depending on the unknown function. 



1.1 Organization of the paper 

Section 2 is devoted to a summary of the applications of Generating function theory 
to symplectic topology, in a slightly modified version with respect to [Viterbo T] . We 
also state the main properties of variational solutions as in [Viterbo-OttolengE . 

Section 3 deals with the proof of theorem 1.2. The proof is based on continuity 
properties of the symplectic norm c defined in Section 2. We prove that if {-ffn, Kn} 
are C°, small, the flows of Hn and Kn have the following properties: 

on one hand t — > (pl^ip^ip~^ip~^ is generated by a C° small Hamiltonian, and 
the properties of c established in the previous section imply that c(v9^'?/'*y9~Vn is 
small. On the other hand, if if„ goes to H with flow and Kn goes to K with 
flow ifn'ipn'^n^i'n^) g^^s to if^ ifj^ ip~'^ " . Uniqucness of limits and the fact that 
c only vanishes on the identity implies that Lp^ip'^(p~^ip~^ = Id for all s,t, hence H 
and K commute. 

In section 4 we ffist show how multi-time equations have natural variational solu- 
tions, provided the Hamiltonians commute. We then address a number of technical 
questions, replacing the invariants of section 2 by their stabilization. 

Section 5 eventually completes the proof of theorem 1.3. It is sufficient to deal 
with equation (MHJ) in the case of two Hamiltonians. Assume the two Hamiltonians 
are such that {Hi,H2} is C° small. We then construct two Lagrangians, L12 and 

''that is, the flow is defined for aU i in R 
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L2,i obtained by "solving" the first of tfie two equations (for t2 = 0) and then the 
second, and vice versa. We must then prove that the two Lagrangians Li^2 and L2,i 
are close with respect to the 7 distance defined in [Viterbo Ij and also in subsection 
2.1(this is not so with respect to the distance). Once this is granted, it implies 
that the associated function mi 2 and ^2,1 are C° close. The proof of the theorem is 
now obtained by limiting arguments. 

Appendix A gives the proof of some technical results. Appendix B extends 
the scope of the main theorems to the case of a non compact support. Appendix 
C,D,E give some complements on equations involving the unknown function, the 
geometric theory of Hamilton- Jacobi equations associated to coisotropic manifolds 
and historical comments. 
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2 Preliminary material 

2.1 Generating functions and variational solutions of Hamilton- 
Jacob i equations 

We shall here assume that N is a connected manifold without boundary, and either 
compact or that all Hamiltonians are compact supported, as in f Viterbo iJ /. However, 
we shall explain in Appendix\^ how our results extend to non-compact situations, 
provided we have some estimate on the growth of the Hamiltonians. 

Let T*N be the cotangent bundle of the manifold N endowed with the canonical 
symplectic structure a = Yl^=i^Pj ^ ■ To any Hamiltonian H{t,z) (where z = 
{x,p)) on M X T*N we associate the time-dependent vector field Xh defined by 

cr{XH,0 = -d.H{t,z)^ 

and the corresponding Hamiltonian flow ip^^ defined by 
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I < = Id 



Let L be a Lagrangian submanifold of T*N obtained from the zero section Otv = 
{(x, 0) G T*N I X G A^} by the Hamihonian isotopy (p\^. We shall always assume 
that ip\^ is well defined on Oat for all t. Then according to |Sikorav-^j (relying on joint 
work with Laudenbach in [Laudenbach-Sikoravj ) . there exists a generating function 
quadratic at infinity for L i.e. there exists a smooth function S" : x M'^ ^ M such 
that 

(a) . {x,S,) t— > ^(x, ^) has as a regular value (a Morse family in the terminology 

introduced by A. Weinstein in [Weinstem] ) 

(b) . S{x,C) = QiO ^ large enough, where Q is a non-degenerate quadratic 

form@. 

(c) . 

L = {{x,^{x,O)\^{x,O = 0} 

In particular the critical points of S are in one to one correspondence with the 
points of L n Otv. 

In the rest of the paper, we shall shorten the expression "generating function 
quadratic at infinity" by "GFQI". 

Let S''^ = {(x,^) I S{x,^) < A}, E"^ be the positive and negative eigenspaces of 
Q, and be large discs in E^. Since for c large enough S^'^ = N x Q^'^ we have 

H*{S'', S-") = H*{Nx Q% N X Q-^) = H*{N) ® H*{D~, dD') 

so that, to each cohomology class a G H*{N) we may associate a class, image of a 
by the Kiinneth isomorphism, denoted by Ta. To the class Ta in H*{S'^, S~'^), we 
may associate a minimax critical level 

c(a, S) = inf{A | Ta i Ker(if*(5", S'^) H*{S\ 5-"))} 

^This is sometimes conveniently replaced by the condition \S{x, •) — Q{-)\c'^ < +oo. We shall 
use these conditions interchangeably in the rest of the paper. It is easy to prove that existence of a 
generating function of one kind is equivalent to the existence of a generating function of the other 
kind, see [Brunella] . 
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Now it is proved in |Theret 2] and |ViterboT] that given L, 5* is essentially unique up 
to adding a constant, and more precisely, up to a global shift, the numbers c{a, S) 
depend only on L, not on S, and they are thus denoted by c{a,L). Moreover, 
denoting by 

7(L) = c(/i,L)-c(l,L) 

where 1 G H^{N),fi G H^{N) are generators. We know that ^{L) is well defined 
and vanishes if and only if L = Oat (see for instance [ViterboT] ) . 

Moreover let Sx{^) = S{x,^) be the restriction of 5" to the fiber over x. We can 
look for a minimax as above for the function S^. Since the cohomology of the point 
is one dimensional, denoting its generator by l^^, we set 

Definition 2.1. The continuous function 

uiix) = c(l^, Sx) 
is called the variational solution of the equation 

(x, du{x)) G L. 

In particular if L C if^^(O) is a variational solution of the Hamilton- Jacobi 
equation 

H{x,du{x)) = 



It has been proved by Sikorav and Chaperon (see [Chaperon ISikorav Ij and also 



Viterbo-Ottolenghi] ) , that such a function is indeed a solution of the Lagrangian 



Hamilton- J acohi equation, that is 

(x, duL{x)) is in L for almost all a; in 
When L C if~^(0), we have a solution of the classical Hamilton- Jacobi equation 

H{x, duiix)) = for almost all x in 

Of course, for any constant c, ul{x) + c is also a solution. For evolution equations, 
that is 



f (t,x) + ff(t,x,f (t,x)) = 
m(0,x) = f{x) 
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the construction of variational solutions for a single equation can be rephrased as fol- 
lows. Let Aq be a Lagrangian submanifold of T*N, and H{t, z) be a time- dependent 
Hamiltonian. We consider Kq^h = {(0, —H{0,z),z) \ z G Aq}, and 

L = |J$*(Ao,h) C T*(M X A^) 



In |Viterbo-Ottolenghi| , it is also proved that for evolution equations the defini- 
tion of variational solutions extends to Hamiltonians: indeed if if tends to H, 
then the solution converges to u. This follows from the property 

\uh — Uk\cO{[0,T]xR") < T\\H — -ft'||cO([0,r]xR2n) 

which in turn follows from Proposition 12.61 (see Viterbo-Ottolenghi I Viterbo "2] ) . 



Note that in the framework of viscosity solutions, this property is called stability. 
A priori, even though u is Lipschitz -hence according to Rademacher theorem is 
almost everywhere differentiable- we do not claim that u satisfies the Hamilton- 
Jacobi equation almost everywhere 



2.2 Capacities for Hamiltonian flows 

Let Li, L2 be Lagrangian submanifolds generated by 5*1, 6*2. We may define c(q;, 5*1 — 
5*2), and as this does not depend on the choice of ^i, 5*2 but only on Li, L2 we denote 
it by abuse of language c(a, Li — L2), even though it is not really determined by the 

set 

Li - L2 = {{x,pi -P2) I {x,pi) e Li, {x,p2) e L2} 

but depends on both Li and L2. 

We denote by 7(^1 — L2) the difference c(/x, Li — L2) — c(l,Li — L2). This is 
non- negative according to [Viterbo T] and vanishes if and only if Li = L2. 

Now to a compact supported symplectic isotopy, denoted by we may associate 
a symplectic invariant as follows: 

Definition 2.2. Let ^ be the set of Lagrangian submanifolds Hamiltonianly iso- 
topic to the zero section, Jif{T*N) be the set of smooth time-dependent Hamilto- 
nians on M X T*N, ^Jif{T*N) be the set of time one maps of such Hamiltonians. 
We shall use the notation J^, SiM' if there is no ambiguity. We set for G ^ 

7(^) = sup{7(^(L) - L) I L G ^} 
^This is the case for viscosity solutions, but is unknown for variational solutions. 
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We shall need the following 
Proposition 2.3. (a). 

iW > 

and = if and only if ip = 

(b) . 

(c) . (triangle inequality) 

^{ifjip) < 7(V^) +7(¥?) 

(d) . (invariance by conjugation) 

Proof. The proof of this proposition is postponed to Appendix |X] □ 

Definition 2.4. We shall say that the sequence in c-converges to if 

and only if 

We shall use the notation 
for c-convergenc^. 

Remark 2.5. Since our invariant is called 7, we should talk about 7-convergence. In 
fact our c-convergence is indeed related to F-convergence in the calculus of variations, 
but we want to avoid any confusion here. 

We also need the following estimate: 

Proposition 2.6. Assume ip is the time one map of the Hamiltonian H{t, z). Then 
we have 

7(V^) < ll^llco := sup H{t,z)- inf H{t,z) 

(i,2)e[o,i]xR2" (t,2)e[o,i]xK2" 

As a consequence, if (pn and ip are generated by and H, and if — > H in the 
C° topology, then (pn c-converges to ip. 

stands for capacity, see |Ekeland-Hofer) . 
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Proof. We first prove that if Hq, Hi are Hamiltonians and (po, (pi are tfieir flows, 
we may normalize 5*0, 5*1 generating functions of v9o(-^), V^i(-^) so that their critical 
values are those of 

Sj{x{l)-^,i) = S{x{Q),i)+ [ p{t)xit) + H,{t,x{t),p{t))dt 

Jo 

with respect to the (infinite) auxiliary parameters 7, ^, and were S is generating 
function quadratic at infinity for L, and 7 = {x,p) : [0, 1] T*N. Indeed we have 



D5,(x(l);7,0 {6x{l),6x{0),6-f,6O 

p{l)6x{l) + — (x(0), - [p{0) - ^(^(0), ) Sxm 

OH \ f dH 

x{t) + -^{x{t),p{t))j 5p{t) - {p{t) - -^{x{t),p{t)) ] 6x{t) 



dt 



According to [Viterbo T] . [Theret 2] generating functions associated to a La- 
grangian are "essentially unique", up to a constant. Thus the critical values of two 
such functions differ by a global translation. Since Sj{x{l)] 7, ^) is formally a gener- 
ating function, and in particular has critical values coinciding up to translation with 
those of any other generating function, we may use its critical values to normalize 
the Sj (i.e. we replace Sj by Sj + Cj so that the critical values of Sj + Cj and Sj 
coincide). 

In particular we claim that if Hq < Hi we have c(a, 5*0) < c(a, ^i). 

For this we argue as in the proof of proposition 4.6 from [Viterbo T] . We consider 
the linear interpolation Hxit,x,p) = (1 — X)Ho{t,x,p) + XHi{t,x,p). Let (p\ be the 
flow of Hx and (p\ be the time one map. The associated generating function S\{x,^) 
of ^px{L) is normalized as above. Now for a critical point of S'a, we get an intersection 
point (xa,0) = (xa(1),Pa(1)) of (p\{L) fl On and the critical values are those of 

Sx{x{iy,j,O = S{x{0),O+ [ [p{t)x{t)+Hx{t,x{t),p{t))]dt 

Jo 

corresponding to critical points of the form (xa(1), 7a, ■Ca) where 

7A(t) = (xA(t),PA(t)) = v^1(xa(0),pa(0)) 

and 

^^(a:A(0),eA) = 
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Using the fact that generically x\ = xx{l) is piecewise C^, and S{xx,C,\) is 
continuous, it is enough to know that for all but a finite set of values of A we may 
write 

-Sx{xx,^x)= —Hx{t,xx{t),px{t)) 



dX Jq dX 

and this quantity is positive if Hq < Hi. 

Now 1 1 -f/^ 1 1 0*0 = C means that a < H < b with b — a < C. Then, since for the 
constant Hamiltonian ha{x) = a, 

c{fi, Sa) = c(l. So) = a 

(again because of the above normalization) and we get a < c(l, Sh) < c(/i, Sh) < b 
and we have 'j{Sh) < b ~ a = ||-f^||co D 

Remark 2.7. As the referee pointed out, A. Weinstein noticed long ago that the 
action functional is a "generating function" in some generalized sense. Taking some 
finite dimensional reduction of this, one can associate to H a GFQI Sh such that 

\\Sh-Sk\\ < 11^ -^11- 

Corollary 2.8. Assume Hy — > H in the C° topology, where H is in C^'^ , (i.e. it 
has Lipschitz derivatives), and v^t) o,''^^ the flows of Hy and H . Then for all t, ipl, 
c- converges to (p*: (f^ — ^ 

Proof. Indeed v^'Vt is the flow of Hy{t, Lp*{z)) — H{t, Lp^{z)), and clearly if — ^ H 
in the C° topology, this quantity goes to zero, hence 7(<^~*v9t) go^s to zero, which 
is equivalent to — ^ □ 

Remark 2.9. Given the time one map of a symplectomorphism of the symplectic 
manifold M, we may define its Hofer norm as follows ( [Hofer j ) Let ^{{(f) be the 
set of (time-dependent) Hamiltonians on M such that the time one flow associated 
to H is ip. 
Then 

y\\ =inf ( / [meix H{t,x) -mi H{t,x)]dt\ H en{^) 
[Jo ^ ^ 

In fact, the proofs of both proposition 2.6 and corollary 2.7 show more than 
stated: we prove that the identity map from (7i, || • ||) to (7i, 7) is a contraction, or 
in less pedantic terms, that 
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This allows to set the following definition, as in |Humiliere] : 

Definition 2.10. ( |Humiliere] ) We define $jj{M) the completion of Jf{M) for the 
metric 7, and SjD^{M) the completion of ^J^{M) for the metric 7. 

Let us point out that the "time one fiow" map J^{M) — > S)M'{M) extends to 
a continuous map ^^{M) — > ioD^(M). According to Proposition 2.6, we have a 
continuous map of C*^(M x M) into S^^{M). Moreover, according to a theorem of V. 
Humiliere ( [Humilierej ) . Hamiltonians with some controlled singularities also live in 



2.3 Viscosity solutions 

The only fact the reader needs to know here about viscosity solutions is Zhukovskaia's 
theorem. For his convenience, we repeat the definition of viscosity solutions in the 
framework of evolution equations 

Definition 2.11. A viscosity subsolution (resp. supersolution) of the Hamilton- 
Jacobi equation 

f (t,a;) + if(t,x,f (t,a;)) = 
M(0,a;) = f{x) 

is a function u satisfying the initial condition and such that if ^p{t,x) is a function 
such that u{t, x) — (p{t, x) has a local maximum (resp. minimum) at (to, Xq) we have 



f(t,a;) + iJ(t,x,f(t,a;))<0 (resp. > 0) 

Moreover -u is a viscosity solution if and only if it is both a viscosity subsolution and 
a viscosity supersolution. 

We now have 

Theorem 2.12 (Zhukovskaia's theorem). (\Zhukovskaydl , IBernardi- Cardinl^ ) If H 
is convex in p then a function u{t, x) is a viscosity solution of the Hamilton- Jacobi 
equation 

f (t,x) + if(t,x,f (t,x)) = 
m(0,x) = f{x) 

if and only if it is a variational solution. 

Note that an example was given in Viterbo-Ottolenghi] showing that this theo- 
rem fails if we remove the convexity assumption. 
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3 Commuting autonomous Hamiltonians and the 



proof of theorem 11.2 



Let / : Pi ^ P2 be a diffeomorphism between two manfiolds, and X be a vector field 
on Ml, then the push-forward of X, f^.X is defined as the vector field: f^:X{y) = 
df{f~^{y))X{f~^{y)). Its main property is that if is the fiow of X, then 

|(/ov^*)(x) = (/.X)(/ov.*(a:)) 

since 

|(/o^*)(x) = df{^\x))X{^\x)) = df{f-'fo^\x))X{f-'fo^\x)) = hX{f^\x)) 

Proposition 3.1. Let H,K be two autonomous C^'^ Hamiltonians of the symplectic 
manfiold M and assume {H, K} to be small. Then denoting by <y9*, the Hamil- 
tonian flows of H and K , the Hamiltonian isotopy t ^— (f'^ip'^(p~'^ip~^ is generated by 
a C° small (time- dependent) Hamiltonian. 

Proof. Indeed we have, setting u = Lp^il)'^ip~^il)~'^{x): 

[XH-{v'r)*XH\{u), 

and since for each symplectic diffeomorphism, p, we have p^Xi = Xip-i, the vector 
field [Xh — is Hamiltonian, with Hamiltonian function 

L,{t,x) = H{x)-H{^-'ip-\x)) 

We may thus compute 

= -^i/(V^-V-*(x)) = dH{^-'^-\x)yXKii^-'^'\x)) = 

and since H{lp~*{x)) = H{x), we have Lq = and we may then estimate 

\Ls{t,x)\ = \Ls{t,x) - Lo{t,x)\ < J \-^L^{t,x)\da < 

' \{H,K}ii;-'^ip-\x))\da < s\\{H,K}\\co 
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Thus if i^'ll is C° small, for each s, the flow t !—> (p^tp'^ip * is generated 
by a C'^ small Hamiltonian. □ 

Remember that according to definition 11.11 two autonomous Hamiltonians H 
and K C^'-commute if and only if there exist sequences of smooth Hamiltonians 
Hn, Kn such that, in the C° topology: if„ goes to iJ, Kn goes to K, and {Hn, Kn} 
goes to zero. 

Fortunately this definition does not conflict with the standard one according to 
theorem 11.21 that we now prove: 

Proof of theorem li.M Remember that all Hamiltonians are compact supported. We 
shall explain in appendix [B] how to extend this to more general situations. 

We also assume temporarily that H,K are of class C^'^. Let now Hn,Kn be a 
sequence of compact supported C^'^ Hamiltonians, such that their C°-limits satisfy: 

(a) . hm„^oo Hn = H, lim„^oo = K 

(b) . lim„_oo{i^n, ^n} = 

We wish to prove that if H,K are C^'^ then {H,K} = 0. Let ^p^yipn flows 
of Hn,Kn, and set pn{s,t,x) = Lp\{ip^ip~*ip~''{x). The flow t i— > pn{s,t,x) is the flow 
of the Hamiltonian x). 

Making use of the topology of c-convergence from definition 12.41 above and apply- 
ing Corollary l2.8l we have that c-converges to and ip^ to ip'^. Using the triangle 
inequality for 7 we see that ipl^ipn'^n^i'n^ c-converges to (f*ip'^(p~*ip~^. On the other 
hand, according to proposition 13. 11 since {Hn, Kn} is C° small, 'j{^Pn4'n'^n^'ipn^) go^s 
to zero and thus, using proposition 12.61 we get that ip^ilj^ip~''^ilj~^ = Id. Since this 
holds for any s, t, it obviously implies that H and K commute. This concludes our 
proof. □ 

The proof required the Hamiltonians to be C^'^ in order to define the flows of 
Xh, Xk- One should be able to deal with the slightly more general case by using 
the methods of |Humiliere] . 

The same proof shows that the following definition of commutation is also com- 
patible with the standard one 

Definition 3.2. Let H, K be two C° Hamiltonians on T*N. We shall say that H 
and K c-commute if and only if there exists sequences Kn such that denoting 
the flows of Hn and H by v^J^, and those of Kn and K hj tpn, ip^ (since H, K are 
only C", the flows are only defined in S)D^{M)), we have 
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Note that even though this is a very natural notion, it is not the one we will 
need to generalize theorem 11.21 

3.1 The time-dependent and multi-time case 
3.1.1 The time-dependent case 

Assume now if, K are time- dependent, that is of the form H{t, z) and K{t, z). Com- 
mutation is then expressed by different formulas. If X^^Xk are the Hamiltonian 
vector fields, we define 

dH OK 

[H, K]{t, z) = d,H{t, z)XK{t, z) + — (t, z) - — (t, z) 

In the sequel, even for time-dependent vector fields we denote by {H, K}{t, z) 
the Poisson bracket of H, K for fixed time, that is {if, i^}(t, z) = dxH{t, z)XK{t, z), 
so that 

[H, K]{t, z) = {H, K}{t, z) + ^(t, z) - ^{t, z) 

The vanishing of [if, K] has the following interpretation. To if (t, z) we may 
associate the autonomous Hamiltonian 

H{t,T,z) = T + H{t,z) 

defined on (M^ x M, dr A dt + u), and the associated flow is 

<l>^ : (t, T,z)^{t + s,T + Hit, z) - Hit + s, ip\^%z)), ifl-^^z)) 

where (p^^" is the flow on M of the non autonomous Hamiltonian H{t,x). 
Similarly to K we associate Now it is easy to check that [H,K]{t,z) = 
{if, K}{t, r, z), the commutation of and implies obviously that 

for any a, b, c, d with d — b = c — a. 

With this definition, the results of the previous section can be extended to the 
time-dependent case. 
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Definition 3.3. Let H{t, z), K{t, z) be two continuous Hamiltonians. We shall say 
that H and K (^''-commute if and only if there are sequences Hn, Kn such that 
[Hn, Kn] goes to zero in the C° topology. 

If H, K are of class C^'^ this definition coincides with the condition [if, K] = 0. 



3.1.2 The multi-time case 

We shall limit ourselves to the case d = 2. We consider H{s,t, z), K{s,t, z) and we 
consider the Hamiltonian flows 



d 
ds 

Then, we consider the Hamiltonians on T*{N x R^) given by 



—y,^it;x)=XKis,t,ipl^{t;x)) 



H{s, t, cr,T,x) = r + H{s, t, z) 

K{s, t, (7,T,x) = cr + K{s, t, z) 

Denote their flows by respectively. The last component of $"(s, t, a, r) is 

given by ^p^^^°'{s■, z) and the last component of ^'^{s, t, a, r) by ilj^~^^{t; z). 
Now 

~ ~ dH dK 

{H, K} = {H, K}{s, t, z) + — (s, t, z) - —{s, t, z) 

and the commutation of the flows ^l^it'-, x) and ip\^{s\ x) is given by the vanishing 
of the above expression. 

Definition 3.4. We set 

dH dK 
<^H,K:^= {H, K}{s, t, z) + —{s, t, z) - —{s, t, z) 

Proposition 3.5. The "flows" ipl^{t; z) andip\^{s]z) commute, or more explicitly 

V-U^o; z)) = tPlis; ^l^{to] z)) 

if and only if H,K ^= 0. 



Remark 3.6. By applying Proposition 13.11 we get that all our different notions of 
commutation (in the time-dependent or multi-time case) are well defined in the 
continuous case, and the definition is compatible with the usual definition in the 
C^'^ case. 



18 



4 Multi-time Hamilton-Jacobi equations and the 
proof of theorem 11.3 



Consider the system of equations (MHJ) defined in the introduction. For small 
ti, ...,td, and a Hamiltonian of class C^'^, we can find a solution to the above equation 
provided the Hamiltonians commute in the sense of the previous section, that is the 
functions tj + Hj{ti, ..,td,x,p) commute on T*(M'^ x N), which we can rewrite as: 



(HI) {H^, H,}it, z) + --^(t, z)-—^{t,z) = QteM.\ze T*N 

Otk Otj 

4.1 The smooth case 

Under assumption (IHip it is easy to check that the method of characteristics will 
yield a solution for tj small. 

Let us remind the reader of the geometric approach to this method. Set 

A/;Hi,...,H, = {(0,...,0,x,-ifi(0,...,0,x,c(f(x)),...,-//rf(0,...,x,rf/(x)),c//(x)) I X G AT} 

This is an isotropic submanifold in T*(A^xM'^), and the vector fields Xj associated 
to Hj(ti, ...,td,Ti, ...,Td,x,p) = Tj + Hj(ti, ..,td,x,p) being pairwise in involution, are 
all tangents to the submanifold 

s=n^7'(o) 

and transverse to Af-Hi,...,Ha- As a result the flows $*• of Xj commute and defining 

Lf;H.,...,H,= u $^..$^..$*^(A/;H„...,HJ 



the commutation property insures that the order in which we take the ^j is 
irrelevant, and that Lf.Hi,...,Ha is a Lagrangian submanifold contained in H~^{0), 
hence in S . 



The following lemma is a straightforward extension of a result from Viterbo-Ottolenghi 



Lemma 4.1. The manifold Lf.Hi,...,Ha Hamiltonianly isotopic to the zero section 
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Proof. Consider the family $J;^ of flows of the Hamiltonian Tj + XH{ti, ...,td,x,p). 
We have = $J and $Jq is the translation by r in the tj coordinate. 

Now the family ^^ is a continuous family of proper maps, and the family of 
Lagrangian submanifolds given by 

L'f;m,-A = U • • • $5^A • • • ^:x{Axf;m,...,H,) 

ii,...,ideM'* 

is an exact proper Hamiltonian isotopy of Lagrangian submanifolds. 
Note that we do not need here that the Hamiltonians commute, and we shall 
indeed use the lemma in the more general setting. □ 

Now, still assuming the Hj are of class C^'^ in {x,p), section [2] implies that 
Lf -Hi,...,Hd has a GFQI. We thus have a variational solution Uf^Hi,...,Hd of the following 
equations 

^U(ti,t2, . . . ,td,x) + Hi(ti,t2,...,td,X,-§^u(ti,t2,...,td-l,td,x))=0 
W I ^U{0,t2, . . . ,td,x) + H2{0,t2 . . . ,td,x,-§^u{0,t2. . . ,td-l,td,x)) = 

^ J^«(0,0,...,td,x) + Hd{0,0,...,td,x,£u{0,0,...,0,td,x)) = 

The commutation of the implies that for any permutation a of 
the Lagrangian manifold 

it-L,...,tq)mi 

coincides with 

Lf-Hi,...,Ha 

Thus the associated function u^^.^^ jj^ = Uf-H„^i-),...,H„^a^ coincides with Uf^Hi,...,Hd- 
As a result, m is a solution of any equation obtained by a replacing ^ by and 
Hj by Hcr{j). Looking at the first equation, we see that 



d d 

-U{ti,t2, ...,td,x)+ H„(i){ti,t2, ...,td,X, -K-U{tl, t2,..., td-l, td, X)) = 



Ota{l) ox 

and since a{l) is arbitrary, we see that u solves (MHJ). 
Our problem is thus solved for initial data and equation of class C^'^. 
However we are really interested in the case. This is the subject of the next 
section. 
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4.2 The continuous case 

To deal with the C° case, we must first extend the construction of the Lagrangian 
submanifold 

Lf-H^,...,Ha 

to general Hamiltonians and initial conditions. Note that since the Hamiltonians do 
not commute anymore, order now matters. We shall consider for each permutation 
a of {1, c?}, the manifold 

^f;Hu-,Ha 

and as in Lemma 4.1, the manifold L^-h^ Hamiltonianly isotopic to the zero 

section, thus to each such Lagrangian we may associate a unique function u'^. 

If the Hj are only C° and we consider a sequence Hj of Hamiltonians converg- 
ing to Hj. We shall then associate to these a sequence of Lagrangian submanifolds 
and a sequence of functions u^, which for a = Id, is the solution of the set of 
equations obtained by replacing in (^) the Hj by Hj. 

We thus want to prove that the conditions lim,^_^oo Hj = Hj, and limj,_,oo{-f^J, Hj^} = 
0, imply 

lim |-u)^ — m!;^! = 

for any permutations a, r. One should notice that this does not say much about the 
L"-H'( particular we do not claim their convergence in the C° sense. 

Proposition 4.2. AssumeYmvy^oo = f, ^i^u-*ooHj = Hj and\im,y^oD{Hj , H^} = 
0. Then Uf-Hi,...,Ha = ^i^u^oou'^ is independent of a and is a solution of the multi- 
time Hamilton- Jacobi equation (MHJ). Moreover Uf-Hi,...,Ha is a variational solution 
of each single equation. If the Hj are convex in p, then according to IZhukovskaya)^ 
variational and viscosity solutions do coincide and thus Uf-Hi,...,Hd is the viscosity 
solution of each single equation. 

The proof of this proposition will follow from a more general theorem, involving 
c-convergence. From now on, we shall only consider the case d = 2, since the general 
case is in all respects similar. 

4.3 Capacity for manifolds with boundary 

In the sequel we shall need to define 7 on ^ in the symplectic manifold T*([0, 1] x A^) 
and S'u){T*{\Q,V\^ x A^) or more generally for the case of the cotangent bundle of 
a manifold M with boundary. Let M be a manifold with boundary, and L be a 
Lagrangian submanifold in T*N such that dL = L n Tq^N . Assuming moreover 
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the intersection to be transverse, we can consider the manifold L C T*{N) where 
Z, N are the doubles of L, N. We shall write TV = U A^+, L = L_ U and we 
identify L,N with L-,N-. We also denote by r be the involution of N sending 
N_ to A^+, and by t the coordinate defining the collar of dM. By assumption, the 
reduction of L by {t = to}? denoted by Lt^ is a Lagrangian regular homotopy. We 
may modify this family near {t = 0}, so that it is constant for t close to 0. Then 
near {t = 0}, L is uniquely defined by the real function T{t, z) defined on [0, e] x Lq 
such that L — {(i, T(i, z),z) | z G Lt). Then r(t, z) = t{z) near t = 0, and we may 
thus extend r and Lt to x Lq, so that r(— t, = T(t,z) and = L^. This 

way we may extend L to a Lagrangian manifold L C T*M, uniquely defined by L. 

Notice that if L is Hamiltonianly isotopic to the zero section, by a Hamiltonian 
preserving Tqj^N, then clearly the same holds for L. Therefore L has a GFQI, and 
we can compute ^{L). We define 7(L) = ^{L). Note also that if S{x,^) is a GFQI 
for L, then {t*S){x,^) — S{t{x),^) also generates L. In fact any S generating L 
over T*N has such an extension. 

4.4 S'-commuting Hamiltonians 

Remember that we denoted by J^{M) be the set of smooth time-dependent Hamil- 
tonians on R X M, and by J^^(M) the set of time one maps of such Hamiltonians, 
and defined S)^{M), the completion of J^{M) for the metric 7, and SjD^{M) the 
completion of J€^^{M) for the metric 7. 

As we pointed out, the "time one fiow" map (M) — )• J^f^{M) extends to a 
continuous map Sj^,{M) — > S^Dj{M), and in particular is well defined on the set of 
continuous maps C*^(]R x M). 

Let ip^^ip^ be the flows of the autonomous Hamiltonians H and K. Then we 
introduce the following commutation condition. Consider p*^*'*) = ip^ip^(p~^ip~''^ for 
(s, t) e [0, 1]^, and the map 

C{H,K) : {s,t,a,T,z) ^ {s,t,a{s,t, z),T{s,t, z), p^'^'\z)) 

from T*([0, 1]^ x N) into itself. We may choose a,r such that C{H, K) is a Hamil- 
tonian diffeomorphism, using the fact that A p(*''^*) is an Hamiltonian isotopy 
starting from the identity. The functions 5, r are well deflned up to the addition of 

t) and |f(-s,t) respectively, where c is some function. 
If we are given Hamiltonians H{z), K{z) generating ■0*, we can assume s — > 

is generated by 

Lt{s,z)^H{z)-H{,p-'ip-%z)) 
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We may also compute 

d 



^^L,{s,z) = {H,K}ir'^-^iz)) 



and note that 



Jo 

Note that if either M is compact and we impose the condition Jj^^ Hj{z)uj^ or 
Hj are compact supported, then Lt^{ti,z) will satisfy the same condition, and this 
defines uniquely C (if, K) as the time one map of a Hamiltonian satisfying this 
normalization condition. 

Definition 4.3. (a). We shall say that ip'^^ip^ S'-commute up to e, if and only if 
7(C(/f,K))<£. 

(b). Let if, K be in S)Dry{T*N). We say that they ^'-commute, if and only if there 
are sequences Hj, Kj such that Hj, Kj converge to H, K (for the metric 7) and 
^{C{Hj, Kj)) goes to zero. 

We now have 

Lemma 4.4. (a). If <^\,<^\ S-commute up to e then 7(p(*i'*2)) < ^ for all pairs 
(ti, ^2) G [0, 1]^. In particular S-commuting Hamiltonians c-commute. 

(h). If for all (^1,^2) ii^ [0, 1]^, the Hofer norm of p^^^'^'^\ is less than e, then v?i,V^2 
c-commute up to e. In particular C^-commuting Hamiltonians S-commute. 

Proof. The first statement follows easily by symplectic and the reduction inequality 
(see [Viterbo T] . page 705, prop. 5.1) that can be stated as follows: 

Let S{x,y,^) be a GFQI, and denote by the function Sx{y,^) = S{x,y,^). 

Then 

c(l, S) < inf c{l^, S^) < sup^c{fi^, S) < c{fi, S) 

X 

The second statement follows from the proof of the inequality 

d{U) < 2supci(t/^) 

X 
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in [Viterbo 3] . where d is the displacement energy, i.e. 



d{U) = inf {\H\co I ip]jiU) n [/ = 0} 

□ 

4.5 Different suspensions of Hamiltonian isotopies 

Let H{t, z) be a time- dependent Hamiltonian on T*N . We may associate to H the 
Hamiltonians on r*(M x A^) given by H{t,T,z) = r + H{t,z) and H{s;t,T,z) = 
sH{st, z), with respective flows 

$^ : (t, r,z)-^it + s,r- Hit, ^\+'{z)), ^\+^{z)) 

$^ : (t, r, ^) ^ (t, r - sH{st, ^^^{z)\ ^'^{z)) 

Note that if H is C*^ small, we have, denoting by the translation on the t 
variable, 7($''T_s) and 7($'^) are small, in other words, is c-close to Tg and is 
c-close to /(i. 

5 Proof of theorem 1.3. 

The construction of variational solutions for a single equation can be rephrased 
as follows. Let Aq be a Lagrangian submanifold of T*N , and H{t, z) be a time- 
dependent Hamiltonian. We consider Kq h = {(0, — -ff (0, z), | z G Aq}, and 

We can obtain L as follows. Consider the map 

F : T*(M X M X A^) ^ r*(R x R x A^) 
(s,a,C)H-(s,?,<f^(C)) 

and Lq^h any Lagrangian submanifold in T*(M x A^) such that Ao,/^ C Lo,/^. Let 
t : T*(M X A^) — > M be the projection on the first coordinate of M x A^. 

Proposition 5.1. L is the reduction of F{Lqh) by the coisotropic submanifold 
{s = t}. 

Proof Indeed, we look for the set of (s, a, $''(0, —H{0, z),z)) such that t = s. But 
^'{t, T,z) = {t + s,T + H{t, z) - H(t + s, <^t+'(;z)), ^^t\z)). Intersecting with t = s 
means that we consider the points $'^(0, r, z) where (0, r, z) G Lq h and by assump- 
tion this means that (0, r, z) G Aq^h- n 
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Now we will first estimate 7(Lo,h) and then deduce the inequality 

7(L)<7(F)+7(Lo,i/) 

Lemma 5.2. Any isotopy of {t = 0} in T*{M. x N) can be generated by an 
arbitrarily small Hamiltonian preserving the hypersurfaces {t — to}. 

Proof. Indeed if we have an isotopy of the type (0, r, x,p) i— > (0, r + T'^{x,p),x,p), it 
is induced by a Hamiltonian H{t, x,p) and only depends on ^(0, x,p) = ^T^{x,p). 
The extension of H to T*(M x A^) can be arbitrarily small, for example we may 
take H[s]t,T,x,p) — x{t)^T^{x,p), where x(0) = 1 and x has arbitrarily small C° 
norm. □ 

Proposition 5.3. For any positive e, we may choose Lq^h so that we have 

i{Lo,h) < 7(Ao) + s 

Remark 5.4. Note that necessarily we have ^{Lq^h) > 7(Ao). This follows from the 
reduction inequality. 

Proof. We notice that Lo,o = M x {0} x Aq satisfies obviously 7(I/o,o) — 7(-'^o)- 
Using the notation Lo,o n {t = 0} = Ao,o, the previous lemma allows us to find a 
Hamiltonian isotopy, on r*(M x N) such that 

- preserves t = ^ ^ 

- on t — 0, we have S^(Ao,o) = Ao,_ff 

- is generated by an arbitrarily C° small Hamiltonian. 
Therefore 

7(Lo,i/) = 7(S^(Ao,o)) < 7(S^) + 7(Ao,o) < £ + 7(Ao,o) 

□ 

Corollary 5.5. We have ^{L) < j{F) +7(Ao). Moreover if Li is the Lagrangian 
submanifold associated to Ai and L2 to 7^2, A2, we have 

7(Li - L2) < ° ^2"') + 7(Ai - A2) 
Proof. The first inequality follows from the second by setting 

Li = L,Fi = F,Ai = A,L2 = 0Kxiv,i^2 = Id,A2 = 
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Since Li and L2 are the reductions of Fi{Li^Hi) and F2{Li^Hi), using the reduction 
inequahty it will be enough to prove that 

7(Fi(Li,^^J - F2{L2,H,)) < l{Fi ° ^2"') + 7(Ai - A2) 

Since the map F2 o F^^ sends Fi(Li //J to ^2(^1/^ J, we have by the triangle in- 
equality and the symplectic invariance of 7, 

7(Fi(Li,hJ - F2iL2,H,)) < l{Fr{Lr,H,) - F2{U,h,)) + i{F2{L^,h,) - F2{L2,H,) < 

7(F2 o Ff 1) + 7(^i,/fi - L2,H2) 

so that using invariance by reduction , we have 

7(Li - L2) < 7(i^2 o Ff 1) + 7(Li,Hi - i^2,/fj 

Finally we claim that for any positive e we may find Li^Hi, L2,h2 such that 
■y{Li^Hi — L2^H2) < 7(^-1 — A2) + e. Indeed remember that Li^Hi, L2,h2 are not 
uniquely defined, but just required to be Lagrangian submanifolds contained in 
T + Hi(t,z) = and r + H2(t,z) = respectively, with reductions Li,L2. Since 
7(Li — -^2,0) = 7(Ai — A2) and we saw in Lemma [5.21 that we may go from Li to 
Li.Hi by applying a Hamiltonian with norm less than e, and similarly from ^2,0 
to L2^Hi we get that •y^Li^Hi — -^1,0) and 7(L2,//2 — -f'2,o) are arbitrarily small. We 
may thus conclude 

j{Li^Hi-L2,H2) < 7(-^i,//i --^1,0)+ 7(-^i,o--^^2,o)+7(-^2,o- -^2,1^2) < 2£: + 7(Ai-A2) 
Since e is arbitrarily small, we get the announced inequality. 

□ 

Our goal here is to prove the following theorem 

Theorem 5.6. Assume the Hamiltonians Hi{ti, ..,tci,x,p), Hd{ti, ..,td,x,p) are 
Lipschitz, and S'-commute. Then equation (MHJ) has a unique variational solu- 
tion. If the Hj are convex in p, then u is a viscosity solution of each individual 
equation. 

We limit ourselves to the case d = 2. 

We consider the flows ^l, $2 associated to ti + Hi{ti,t2, z), r2 + 7/2(^1, ^2, z), and 
associated isotopies depending on 2 parameters. More precisely ^f^'^^'^^\t2', z) is the 
flow of {ti,z) — > H{ti,t2,z) between times ti and ti + s ( ^2 being considered as 
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fixed). Similarly ' ^ * (^i;-^) is the flow associated to the Hamiltonian (^25-2) 
H2{ti, t2, z) between times t2 and ^2 + s. 

Then $2 ^'^^ symplectomorphisms from T*(M^ x A^) given by 

$1(^1, t2, Ti, r2, 2;) = (ti + S, t2, Ti + fl{tiM. Z),T2 + f^{tlM, A, Z)) 
t2, n, r2, = (tl + S, t2, Ti + fl{trM. Z),T2 + mUM, A, ^f-'^^'\tx\ z)) 

Note that since L\ = UtigM'^in^o) is not contained in the hypersurface T2 + 
H2iti,t2,x,p) = 0, in order to get a Lagrangian submanifold after applying the 
flow $2 must move Li in the ^ direction, so that its image is included in this 
hypersurface. 

Setting 

^{a,0,^f'''\0;z))da 

and 

L, = {{t,,0,-H^{t,,0,^'^^''^\z)),-H2{0,0,z)+T^^{z),vf'''\0■,z)) \ z = {x,df{x)) e T*N} 

we may indeed check that on Li, T2 + H2{ti,t2, z) vanishes (note that Ai is contained 
in {t2 = 0}). 

We thus define a "normalization map" , defined over {t2 = 0} : 
^1,2 : (h, 0, Ti, T2, z) t-^ (ti, 0, Ti, -H2{ti, 0, z), z) 

and similarly 

^2,1 : (0,t2,Ti,T2,2:) ^^ (0, ^2, -^^1(^1, 0, 2;), r2, 

These maps are not diffeomorphisms, but their restriction to Li (resp. L2) is 
one, and since it preserves the Liouville form (r2(it2 + Tidti + A), its restriction to 
Li (resp. L2) extends to a Hamiltonian isotopy Vi^2 (resp. V2,i) which according to 
lemma 15.21 are generated by arbitrarily C°-small Hamiltonians %. We will use the 
maps 

W^l,2 : (Si,S2,ai,(T2,C) ^ (Si,S2,(Tl,a2,$2'V^i,2$"'') 

^Note that Vi,2 and ¥2,1 depend on Li and L2 respectively. 
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W2,l : (Si, S2, CTl, (72, C) ^ {Sl, ^2, ^2, 1^2,1^1 

also generated by C°-small Hamiltonians. 

Now we claim that the following submanifolds are Lagrangian 

Ll,2= U $l^i/2,i$?(Ao) 

(si,S2)eIR2 

L2,i= u $rv^i,2*r(Ao) 

(si,S2)GK2 

It will later be useful to notice that 

We then consider the map C as above: 

T*{R^ xR^ xN) — > T*{R^ x x A^) 

(Si, 52,^1,^2,0 (Si,S2,5l,52,$l^$2^$r$2"'^(C)) 

where ( = (ti, t2, Ti, T2, z), and the map C = Wi^2 o C o W2i- 

Wc do not claim that C sends L12 to ^2,1, since these manifolds are in T*(M^ x A'") 
and not T*(M2 X M2 X AT). 

However, let A be the coisotropic submanifold of T*(M^ xR? x N) given by 

A = {Si = ti,S2 = ^2} 

Proposition 5.7. _ 

[C(0ffi2 X L2,i)]a = Li,2 

Proof. _ _ 

(Offi2 X Li,2) = {(si,S2,0,0,$*iy2,i$*2'(C)) I C e Ao} 

then 

C(0m2 X L2,l) = {(Si,S2,?l,52,<f?V^l,2$l^$2'^V^2;il$rHC)) I C ^ ^2,1} = 

{(si, 52,5^1, 5^2, ($rvi,2$r*2"''^:i'*r) ° (*i'V^2,i*2')(C)) I C e Ao, (^1,^2) e M^} 
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Now if ti(C) = tiiO = we have 

Thus intersection of this with {si = ^1,^2 = ^2} will be given by 

{(si,s2,5i,52,$^^i^i,2$r$2"''i?2:i'^ro^i'^^2a$?(c) i ce 

{(si,s2,5i,52,$rT4,2$r(C)lCeAo} 
and we must figure out its projection according to the equivalence relation given 

by 

{si,S2,ai,a2,ti,t2,Ti,T2,z) ~ {s[,S2,a[,a2,t[,t'2,T[,T2,z') 

if and only if 

s'l = Si = = t[, S2 = 4 = ^2 = t'2, ai + Ti^ a[ + t[, (J2 + T2 = + T2 
Since the map 

(Si, S2, <Ji, (72, tl, ^2, Ti, T2, 2:) > (Si - tl, S2 - ^2, O"!, CTg, ti, ^2, O"! + Ti, (72 + r2, 2) 

is a symplectomorphism, the reduction of X = C{0^2 x ^2,1) is given by 

= {{Si, S2, C7i + Ti, £72 + T2, z) \ (si, S2, £71, £72, Si, S2, Ti, r2, ^) G X} 

and this yields Li 2 as announced. □ 
Proposition 5.8. Let (^i,^?! S-commute up to e, then we have 

7(Li,2 - -f'2,i) < £ 

Proof. Indeed it is enough to prove that 7(6") is small by assumption ($*, 5"- 
commute up to e). Since 7(C) is small, and Wi,2,1^27i generated by C° small 
Hamiltonians, 7(W^i^2), 7(M^2,i) are also small, and using the triangle inequality, we 
get that 7(C) is small. 
Now if 7((5) <e 

7(C(0k2 X L2,i) - Ok2 X Li,2) < e 
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Using the reduction inequality we obtain 

7(15(0^2 X L2,i) - 0r2 X Li,2)a) < £ 
and according to the above proposition 15.71 we get 

7(^2,1 - Li^2) < e 

□ 

Proof of theorem \1.3[ Indeed we just proved that if ip\,<f2 >S'-commute up to e on 
[0, T], we have 7(1^1,2 — -^2,1) < ^ and thus, by the reduction inequahty we have 

\uiAt,x) - U2,i(t,x)\ < e 

on [0, T] X A^. 

Now assume we have sequences H\,H2 such that c-converges to ifi, H2 
c-converges H2, and H'(,H2 S'-commute up to ej, where hm,^^oei/ = 0. Then we 
have 

K,2(^>a;) - U2,i(t,x)| < 

on [0, T] X A^. 

Now we know that 2 converges to a variational solution of 

^V{ti,t2, X) + Hi{ti,t2, X, ^V{tl, t2, X) =0 
V{0,t2,x) = W{t2,x) 

where w is the variational solution of the equation 

-^W{t2, X) + H2{0, t2, X, ^W{t2, X) =0 

wlo,x) = f{x) 

on the other hand, U2 1 converges to a variational solution of 

^V{ti,t2, X) + H2iti,t2, X, ^V{tl, t2, X) =0 



v{ti, 0, x) = w{ti,x) 
where w is the variational solution of the equation 
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^wih, x) + Hiiti, 0, X, -^wih, x) = 
wiO,x) = f{x) 

Since we proved that ■u^j' 2(^,2;) — U2i(t,x) goes to zero, the sequences have a 
common hmit,u, and this will be a variational solution of both 

d d 

—V{ti,t2, x) + H2{ti, t2, X, h, x) =0 

and 

d d 

—V(ti,t2,x) + Hi(ti,t2,X, —V{ti,t2,x) = 

and such that v{0, 0, x) = f{x). 

In other words, f is a variational solution of (MHJ). □ 

Remark 5.9. Note that the initial condition on the function u need not be given by 
"functions". It is enough to have a "C°- coisotropic sub manifold" C C T*(M'^ x 
A^), that is the Hausdorff limit of submanifolds C^, such that <7tc^ goes to zero 
for the topology, and T*(R'^ x A^) ^ M'^ given by (ti, t^, n, r^, 
(ti, ...,td) when restricted to the leafs of the fohation is uniformly proper. We let 
the reader adapt such a generalization into our framework. We also mention that 
the notion of C°-Lagrangian submanifold has already been used by several authors, 
related to the fact that under various assumptions, we may guarantee that a smooth 
manifold that is the C°-limit of Lagrangian submanifolds has to be Lagrangian (see 
|Laudenbach-Sikorav-2j . [Sikorav-3] . [Viterbo 4] ) . 

A Appendix: Proof of proposition 2.2 

Lemma A.l. Let Li,L2,L^ G =Sf. Then 

7(Li - L3) < 7(Li - L2) + 7(-L2 - L3) 
Proof. Assume first that L2 = On- Then we must prove 

But this follows from corollary 2.8 and Proposition 3.3 on page 693 of [ViterboT] 
according to which 

c{l,-S) = -c(/i, S) 
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and 

c{uv, Si + S2) > c{u, Si) + c{v, S2) 
Indeed, we have 'j{L) = ji—L) and 

c(l, ^1 - ^3) > c(l, Si) + c(l, -^3) = c(l, Si) - c{fi, Ss) 
c(l, S, - Si) > c(l, Ss) + c(l, -Si) = c(l, Ss) - c(/i, ^1) 
using that c(l, 5*3 — Si) = —c{fi, Si — S3) this can be rewritten as 

-c(l, 5*1 - 5*3) < c(/i, 5*3) - c(l, 5*1) 
c(yu, Si - S3) < c(/i, 5*1) - c(l, 5*3) 
and adding the inequahties we get 

7(^1 - ^3) < 7(^1) +7(^3). 

Then we claim that 
(A.l) ^{L - L') = ^{^{L) - v{L')) 

for any in Indeed, according to proposition 3.5 page 695 of [Viterbo T] . if 

L' = p~^{On), we have 

7(v^(L) - cp{L')) = 7(^(L) - ^p-\On)) = 

i{[w-'Y\m) = 1{P{L)) 

Since the last expression does not depend on the choice of we get 

7(¥^(L)-y,(L'))= 7(^-^0 

Let now ip in be such that v^(i^2) = Oat, and let us apply the above equality to 
the Lj-. 

7(Li - L3) = l{v{Li) - ^(La)) < l{^{Li)) + 7(<^(^3)) = 
7(v3(Li) - if{L2)) + l{v{L2) - v{L3)) = 7(Li - L2) + 7(^2 - L3) 

□ 

We are now ready to prove proposition 12.31 stating the main properties of 7. 
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Proof of proposition IKR (a). Assume we have for all L in 7(?/'(L) — L) = 0. 
According to [ViterboT] . corollary 2.3, we have ip{L) = L. Now since this 
holds for any L, we must have = Id. 

(b). Indeed the change of variable in ^ given by L = ip{L') shows that 



7(V'"^) = sup{j{ij-\L) -L)\Le^} = sup{7(L' - ^(L')) \ L' e ^} 

Since 7(— 5*) = 7(5*) we see that the last expression equals 7(V') 

(c) . Again by change of variable, we have 

sup{7(^(^(L) -L)\Le^}< 
sup{7(^^(L) - ^{L)) + 7(^(L) -L)\Le^}< 
sup{7(V'(L') - L') \L' e^} + sup{7((/?(L) - L) \ L e ^} 

The second inequality follows from lemma IATT] 

(d) . Indeed let us make the change of variable L' = ip~^{L), we get 

7(^^y^-^) = sup{7((^^^-')(L)-L) \LE^} = sup{7(^^(L')-^(L')) \ L' E ^} 



Now using the equahty (]A.1|) . we get 



7(^^(L')-v^(L'))= 7(^(^0 -^') 

and thus 

sup{7(^^(L0 - ^{L')) \L'e^} = sup{7(^(L') - L') \ L' e ^] = 7(^) 



□ 



B Appendix : Symplectic invariants and the main 
theorem in the non-compact case 

The aim of this appendix is to extend our construction and results to the case 
where iV is a non-compact manifold. Of course, if all our Hamiltonians are compact 
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supported, the statements and proofs are straightforward adaptations of the compact 
case. We refer to [Barles] and |Fathi-Maderna] for the study, form a different point 
of view, of Hamilton- Jacobi equations in the non-compact setting. 

Let us first consider the problem of solving a single equation in our variational 
framework. For this we start from the isotropic manifold A/, and consider L = 
UteK ^^i-^f,H)- For this to be defined, we need that the Hamiltonian flow is complete, 
or at least that its restriction to Aq^h is complete |^ 

For a general Hamiltonian, we cannot hope to define variational solutions unless 
the associated fiow is complete, but this condition will not suffice, as the following 
example shows. 

Consider the equation 

du _ 2 _ l\du\2 _ n 
at 41(9x1 ^ 

u{0,x) = . 

The variational solution will be u{t, x) = tan(t)a;^ which goes to infinity as t goes to 
— 

2 ■ 

This happens because the Lagrangian submanifold associated to the equation is 
given by 

L = I (t, r, X, p) I 3a E M, X = a cos t,p = 2a sin t, r = } 

and this being vertical for t = |, cannot contain the graph of the differential of some 
function. 

We see that the trouble comes from the fact that the flow at time ^ = f brings 
over {x = 0} points which are arbitrarily far. To avoid this phenomenon we intro- 
duce the notion of "flnite propagation speed Hamiltonian" . We shall see that such a 
flow can be suitably approximated by compact supported flows, and such approxima- 
tion can be used to deflne the variational solutions of the associated Hamilton- Jacobi 
equation. 

We denote by n : T*N — > the projection, by W some exhaustion ( W,,), ,,pn of 
T*N by neighborhoods of the zero section, and by (i^^)^gN some exhaustioio of A^- 

We shall assume that for all /x, and all compact subsets K in A^, fl 'k^^{K), 
is compact. 

^This means that $^(2;) is defined for all z in Af^n- 

^°By exhaustion of a set X, we mean a non-decreasing sequence (YJj);^eN of subsets of X such 
thatM eN>^M=^- 
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Our first task will be to determine when a sequence ((^^) of compact supported 
Hamiltonian isotopies approximates a given Hamiltonian isotopy, -0*, from the 
variational solution point of view. This will be based on 

Proposition B.l. Let cr* be a compact supported Hamiltonian isotopy, L — (7^(0jv); 
p* another compact supported Hamiltonian isotopy generated by H{t,x,p), and set 
p — . Assume we have \H{t,x,p)\ < e on 

U{{p')t^[o,i],L,Q) = {{t,p\z))\t e [0,1] ,zeL, p{z) e 

for some open set fl in N. 

Then for all x in D, we have 

\up{L){x) -UL{x)\<e 

In particular for e — 0, this means that if H vanishes on 

U {t}x{p\Lr^p-\'K-\n))] 

t6[0,l] 

we have 

Up{L){x) — ul{x) for X in Q. 

Proof. We first assume \H\ < e everywhere. Then according to Proposition 2.6 we 
have ^{p{L) — L) < e and the inequality \c{l:^, L') — c{lx, L)\ < 7(L' — L) implies 

K(L){x) - ul{x)\ < -f{p{L) -L)\<s. 

Now to deal with the general case, assume (ifT-),-^^,!] is a smooth one-parameter 
family of compact supported Hamiltonians with Hq — H, and for all r in [0, 1] 

Hr^Ho on U((p*),L, Q). 

We claim that c{lx, Pt{L)) = c{lx,L). 

Now notice that c{lx, Pt{L)) belongs to the set C-,-{x, L) of critical values of 

(x,p,0^ / \p{s)i{s)-Hr{s,x{s),p{s))\ds + S{x{Qi),i) 
Jo 

where is a generating function quadratic at infinity for L. 
The set Cr{x, L) is equal to the set of values of 

/ [pris)Xris) - Hris,Xris),Pris))]ds + F{XriO),p{0)) 

Jo 
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where 



(a) 



{Xr{0),Pr{0)) e L 



Xt-{1) = X 



id) 



dF ^ X on L 



Since by assumption, z & L and p{z) G tt ^(^2) imply Hr = Hq on {{s, p^{z)), s e 
[0, 1]}, we conclude p^{z) — p^{z). 

Thus for X in Q, the set Cr{x, L) does not depend on r. Since Cr{x, L) is the 
set of critical values of the action, it has measure zero, and using the fact that 
Up^{L){.x) = c{lx, Pt{L)) depends continuously on r, we conclude that it must be 
independent of r for x in Q. 

/^From the above argument follows that 



where x{^:^) — fo^" i^:^) ^ U{{p*),L,Q) and x = 1 outside a neighborhood of 
W((p*),L,Q). 

By suitably choosing x^we may assume the following inequality holds 

\Hi\ < £ + 5 

with 5 > arbitrarily small. Since Hr = Hq on U{{p^), L, Vt), we have 

for X in VL. Since \Hi\ < e + 5 everywhere, we may apply the first part of the proof 
and obtain 




Vw(^) -ul{,x)\ <e + 5 



and thus 



\Up{L){x) - Ul{x)\ < £ + 5 . 

Finally, 5 being arbitrarily small, we conclude that 

\up(L){.x) - ul{x)\ < e 



□ 
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Our next task is to associate to the non compact supported Hamiltonian isotopy 
a sequence (v^^^eN of compact supported ones, such that c{lx,(p^f^{L)) converges 

-or rather its restriction to any compact set stabihzes- for fixed x, t, as fi goes to 

infinity. 

We denote by H^{t,z) and H{t,z) the Hamiltonians generating y?^ and ip*, and 
by Kf^^i^(t,z) the Hamiltonian generating p^,^ = ip\^ip~^. 

The equahty V^Jj = V't = "^^ ^ is equivalent to H^{t, z) = Hy(t, z) = H(t, z) 
on for all s G [0,T]. 

Thus if ipjj^ = (pi = ip'^ on 

we have. 

^l^p-/ = id on riw^ n 

hence 

so that, according to proposition lB.il 

u^l,(L){x) = u^i^L){x) for X in 7r"^(n/,) t G [0,T] 
This motivates the 

Definition B.2. Let {tp^)t(z[o^T] be a Hamiltonian isotopy. A sequence of compact 
supported Hamiltonian isotopies, (<^^);igN is an exhausting sequence associated 
to W and (f2^)^GN if for all fi, we have 

s€[0,T] 

The above argument implies 

Proposition B.3. Let (y^p be an exhausting sequence for (^/'*)tg[o,r] associated to 
W and (f2^)^gN- Then for any L, image of the zero section by a compact supported 
Hamiltonian isotopy and contained in some W^, and, for all a, (3 > fi and t G [0, T] 

u^t^t^L){x) = M^^(L)(a;) Vx G fi^ 

We may therefore set 
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Definition B.4. Given (t/'*)te[o,T] and an exhausting sequence (99^) associated to 
W, (ilju)/iGN we define ii^t(L)(a;) to be the common value of the u^t^(^i,){x) for /i large 
enough. Since M^t(L) is a solution of the Hamilton- Jacobi equation, we call it the 
variational solution associated to the exhausting sequence. 

We now need to solve two difficulties. 

First, it is not clear, given {ip*)te[o,T], W , whether we may find an 

associated exhausting sequence. Second, one could wonder whether u^t(^i^^[x) will 
depend on the choice of the exhausting sequence. But this will not be the case, since 
if <^^, (^^ are exhausting sequences, we get a new exhausting sequence by intertwining 
them. Remember that we assume Pi fi^ is compact for all /x. 

Definition B.5. (a). We shall say that {■ijj^)te[o,T] has finite propagation speed 
with respect to W if and only if for each /i, there exists z/ such that 

te[o,T] 

(b). W is a convex exhaustion if the fibers of are convex, that is for ellx E N 
Wn n 7r~^(x) is convex in T*N. 

Note that the composition of finite propagation speed Hamiltonians has finite 
propagation speed (with respect to the same family W) . However this is not neces- 
sarily true for its inverse ((■0*)~^)tg[o,r]- 

The set of Hamiltonians isotopies having, together with their inverse, finite prop- 
agation speed, is a group for the composition law 

Our last result for this section is 

Proposition B. 6. LetW be an exhaustion. If {ip^)t£[o,T] has finite propagation speed 
with respect to W, then, for any exhaustion (fi/i)^eN of N, there exists an exhausting 
sequence ((^^ associated to W. 

The proof makes use of the obvious lemma: 

Lemma B.7. Let K <zU he a compact subset and (V'*)tg[o,i] a Hamiltonian isotopy 
such that 

U i)\K) C U 
te[o,i] 
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Then there is a Hamiltonian isotopy, supported near V such that 

V?* = iIj^ on K for all t in [0, 1] 

Proof. Indeed, if x is a function equal to 1 on V , vanishing outside a neighborhood 
of t/, and H{t,z) generates ip^, then x{z)H{t, z) generates (^*. □ 

Proof. We may now prove the proposition. 
Since for all ^ there exists u such that 

for all s in [0,7], we have 

r{w^) n 7T-\%) cw,n 7r-\n^) cw,n 7r-\n,) 

Thus 



sG[0,T] se[0,T] se[0,T] 

We denote by K,^^t this last set, and note that it is compact. Therefore 

U ^^(^'^-^) 

se[o,T] 

and we may find an isotopy y?^, compact supported, such that (p^^ = ip^ on K^^t- CH 

Now this yields solutions of the evolution Hamilton- Jacobi equations in case the 
initial condition / has compact support. Of course formally the general case can be 
reduced to this one, since solving 

r ^{t,x) + H{t,x,^{t,x))^0 
\ u{0,x)^f{x) 

is equivalent to solving 



^{t,x) + H{t,x,^{t,x) + df{x))^0 
v{0,x) = 

by the change of function v{t, x) — u{t, x) — f{x) (and this change of function 
preserves variational solutions). 

However we would like to have a criterion for H and an independent one for / 
in order to isolate the difficulties. 
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Proposition B.8. Let W be a convex exhaustion. Let Cy\){N) he the union over all 
sets Wfj, of the exhaustion, of the closure of the set of functions with graph 
in Wfj,. Let H^iM. x T*N) be the set of C^'^ Hamiltonians having finite propagation 
speed with respect to W. Let f such that the graph of df is in W^, the function u^tf^j^^ 
does not depend on the choice of the exhausting sequence. Moreover it is a solution 
of the Hamilton- Jacobi equation 



(HJ) 



ulo,x) = f{x) 



Remark B.9. Let ip'^ be the flow of H and Aq C T*N be a Lagrangian submanifold. 

We first notice that the manifold we constructed, L in T*(M x A^) giving the 
solution of (HJ) and the family Lf = ip^{L) give essentially the same information. 
Indeed, if u{t, x) = c{l(^t,x), L) and v{t, x) = 0(1^., Lt) we have u{t, x) — v(t, x) = d(t) 
for some continuous function d. Given v, we can easily determine d or u, since 



^v{t,x) = ^u{t,x), hence 



hence 



—u{t,x) = -H{t,x,—v{t,x)) 



u{t,x) = f{x)+ I H{s,x, —v{s,x))ds 





dx 

Proof. Clearly if Aq is the graph of df, we wish to replace it by a Lagrangian manifold 
A^, such that there exists an isotopy A^ from Aq to A^, such that 

y^liA^) = ^*(Ap = ^*(Ao) 

over 7r-\n^) for all t e [0,T]. 

But <y9^ = on Wf, n so if A^ = Aq over ir^'^^A^), where will 

be determined later, we have 

over 

^l^\w^n{r)-'7^-\n^)nn-\A^)) 

By compactness of 

we may find such that H {ip^)^^7r^^{Qfj,) C 7r^^(/l^), and therefore according 
to proposition IB.3I 
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on n^. 

Now if Ao is the graph of df, we may take for the graph of df^ where 

r^{x) = (1 - sx,{x))f{x) 

and 

f Xti{x) = on 

\ Xf^i^) = 1 near infinity 

Then A^ will coincide with Aq over A^. We still need to prove that A^*^ is in VF^ 
for all s in [0, 1]. Now this coincides with the graph of (1 — sx^i{x))df{x) outside a 
compact set. Since the graph of df is in W^, this will be also in some Wj, for some 
V, provided W^, is fiber convex. 

□ 

Remark B.IO. In practice most are fiber convex, and if this is not the case, we can 
always convexify them. However, it is not clear that a ^0* having finite propagation 
speed with respect to W will have also finite propagation speed with respect to the 
convexified exhaustion W", unless the convexification of W^, is contained in some 

Example B.ll. (a). The Barles-Tourin condition defined for an autonomous Hamil- 
tonian H{x,p) on T*(M") can be rewritten as 

\DpH{x,p)\<f{\p\){l + \x\) 

g4\p\)<\H{x,p)\<gM 
where \im^^^ g±{^) — +oo 

This implies finite propagation speed for the exhaustion by the Ur = {{x,p) \ 
\p\ < r}, since the assumptions and conservation of energy imply that the 
image of Ur — {ix,p) | \p\ < r} by the flow remains in some Ur'- In such a 
region, the first inequality implies, by Gronwall's lemma, finite propagation 
speed. 

(b). Consider the U(^a,b) — {{x,p) \ \p\ < ad{x,xo) + b, and assume 

\D,H{t,x,p)\<C{\p\) 
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\DpH{t,x,p)\ < C{l + d{x,xo)) 

Then the first assumption, together with Gronwall's lemma imphes that the 
flow sends Ua,b to some Ua',b'- 

The proposition imphes that if W is an exhaustion, and / a function on such 
that the graph of df is contained in Wfj_ for some /i, and if H{t,x,p) generates a 
flow having flnite propagation speed with respect to the W, then we may flnd a 
variational solution of 

— (t,x) + H{t,x,—{t,x)) = 
u{0,x) = f{x) 

by considering solutions of 



r ^(t, x) + H^{t, X, £u^it, x)) = 
\ u^(0,x) = f{x) 

where H^^ is a compact supported Hamiltonian generating an exhausting se- 
quence (v5/i)^gN for the flow ip^ of H. 

It follows from the above that u{t,x) = lim^^oo 2;) deflnes a function in- 
dependent of the choice of the exhausting sequence. In the regular case (i.e. for 
smooth data), this will of course be a solution of the equation almost everywhere. 

We may of course combine theorem 15.61 with the above proposition to get the 
following: 

Theorem B.12. Let W denote an exhausting sequence of neighborhoods of On- 
Let C>v(iV) be the union over all sets of the exhaustion, of the 7 closures of 
the set of functions with graph in W^. Let 7i^(M x T*N) be the set of C^'^ 
Hamiltonians having finite propagation speed with respect to W. Consider the closure 
i37,w(K X T*N) ofHl^im X T*N) m ^^^(M x T*N). Finally we assume that 

(/, i/i, Hd) G t{N) X f)7,w(K X T*NY 

then there is a solution 0/ (MHJ) with data {f,Hi,...,Hd). 
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C Appendix : equations involving the unknown 
function 



For equations of the type 

du 

— + Hj{ti, ...,td,x, —u{x),u{x)) = 

the same proofs hold, but we have to replace the cotangent space T*M which is 
symplectic by the jet space J^(M), a contact manifold, on which we use the contact 
form a = dz — pdx. We also replace Lagrangian submanifolds, by Legendrian ones, 
which are manifolds of dimension dim(M) on which a vanishes. It was noticed by 
Chekanov (around 1986, but published in |Chekanov] much later), that the theory 
of generating functions holds also in the Legendrian case, and that existence is 
invariant by Legendrian isotopy. 

Since the notion of generating function applies "even better" to a Legendrian 
submanifold of J^(M), and according to |Theret] . we also have uniqueness of gen- 
erating functions, all the constructions of [ViterboT] apply. Similarly, since the 
Hamiltonian flow of r + H{t,x,u,p) is also well-defined, the constructions from 
|Viterbo-Ottolenghi| also carry through. 

The details of proofs are left to the reader. However, we will make explicit the 
commutativity condition for Hi(ti,t2,x,p,u) and H2(ti,t2,x,p,u). 

This is easy even in a general contact manifold. Indeed, define the Reeb vector 
field R, by the equalities 

i^a = 1 
iptda = 

the associated Hamiltonian vector field must satisfy 

ixjjQ = —H 
ix^da = dH + iji{dH)a 

1 CTnr'ci /^y — rill — i^rJnr 7? — 

du 



(note that for H = —1 we recover R) which in our case, since a = du — pdx, R — ^ 
translates to 



Xh{x,p, u) = {pH, -H)^ + H,-^ - {H, + pH^)-^ 

We then have L^^a = H^a and this shows that Xh preserves the contact 
distribution a = 0. Since the commutator of such vector fields must also preserve 
the contact distribution, we may define 
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Definition C.l. Let Hi{x,p, u) and H2{x,p, u) be two functions on J^(M). We set 

{Hi,H2}s{x,p,u)+ 

[x,p,u) \p—-[x,p,u) -Hi{x,p,u) - —-{x,p,u) \p—-[x,p,u) - H2{x,p,u) 



ou \ op J ou \ op 

where 

' * dp dx dx dp 
Proposition C.2. ^ _ _ 

Now in the multi-time dependent case, for Hi{ti, t2, x,p, u), i?2(^i, h, x,p, u), we 
can consider 

Ki{ti, t2,Ti,T2, X,p, u) = Ti+Hi{ti, t2, X,p, u), ^2(^1, ^2, Ti, T2, X,p, u) = T2+i?2(il, ^2, X,p, u) 

as functions on J^(M^ x M) and set 
Definition C.3. Let Hi,H2 as above. We define 

[[H,,H2]] = [K,,K2] 
The following is the natural extension of Theorem 1.2 : 

Proposition C.4. Assume we have sequences H^, K^, such that H^~^H, — >K, [H^, K^] 
Then [H, K] = 0. 

D Appendix : Coisotropic submanifolds of sym- 
plectic manifolds 

Let (P, a) be a symplectic manifold, and C a coisotropic submanifold, that is 

{T,C)^ c T,C yzeC 

where 

{T,C)^ := {v e T,P : a{v, u) ^ e T,C, } 
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here a is a closed and non degenerated 2-form, e.g. if P = T*M , then a = dO, 
9 = YliPid-x^ is the Liouville 1-form. Let H : T*M M, then the Hamiltonian 
vector field Xh related to H is so defined: 

a{XH, ■) = -dH, 

and the Poisson brackets of two Hamiltonian functions H e K are 

{K, H}{z) = dK{z) ■ Xh{z) {z = {x,p)). 

Let suppose that C is defined by zero's of functional], if" : P ^ R, a = 1, codim C: 

C : H" = rk dH" \^,^^ = max = codim C 

Thus: u G TzC <^==^ dH°'u = 0. Standard homomorphism theorem between linear 
spaces gives existence (and uniqueness, by the max rank) of the Lagrange multipliers 
Aa = K{z,v): 

yv G (T,C)^ : [dH^u = ^ ct{v, u) = O] ^ uj{v, ■) = J2 ^'^^^'^ 

a 

The linear independence of the forms dH"^, a = 1, codimC, implies that the 
following Hamiltonian vector fields ( Xa ) , 

V / a=l,...,codimC 

a(X„ ■) = -dH^, 

span (T^C)-*-. Since (T^C)-^ C T^C, the vectors Xa{z) are in TzC, and their integral 
paths, the characteristics of Xa, are in C, hence 

a(X„X,) =0. 

^From the definition of Poisson brackets {■,■}, 

(^iXa,Xi,) = {Ha,Hi,}, 

and from the well known Lie algebra morphism ([■,■]: Lie brackets) 

[Xa, Xb] = X{HaA}, 

^^it is equivalent to ask that the normal bundle of C, with respect to some Riemannian metric, 
is trivial ( [Guillemin-Pollack] p. 77.) 
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one obtains that the fields ( Xa ) are in involution: 

\ / a=l,...,codimC 

In other words, by Frobenius' theorem, (TC)"*" is a integrable distribution, the char- 
acteristic distribution. Notice that the involution condition of the Hamiltonians 

{Ha,H,} = 

is intrinsic, constitutive, of the coisotropic submanifold C. 



E Appendix: Geometric Theory of Hamilton- Jacobi 
equations on coisotropic submanifolds 

Let us consider d functionally independent and in involution Hamiltonians Ha, a = 
1, ...,d, of the following structure: 

Ha : T*{N X M^) — ^ M 

{Xi, ...Xnjti, , ...,td,Pl, ...Pn,ri, , I > + Ha{ti, , ...,td,X,p) 

The submanifold 

a=l 

is coisotropic (because {Ha, Hb} = 0), dimC = 2n + d, co-dim C = d. 

We call geometric solution of the Hamilton- Jacobi multi-equation related to C every 

Lagrangian submanifolJ^ A C T*(N x MJ^) belonging to C: 

AcC. 

The Lagrangian submanifolds which are graphs of a section of the cotangent bundle 
T*{N X M.'^) are image of the differential of functions S, defined on iV x Mf^, S : 

A • ,o f/ N 9S . . dS . 

A = imdS = ^{x,t,p,T) : p = —[x,t), t = —{x,t)j 



that is, i) <7\\ — and ii) dim A = dimiV x R'^ — n + d. 
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Thus, every globally transverse Lagrangian submanifold A, solving the H-J multi- 
equation related to C, represents, by its generating function S, also a classic solution 
of it: 

dS dS 
(Al) —{x,t) + Haiti,,...,tg,x,—{x,t)) = 0, a = l,...,(i. 

• The characteristics method. The following proposition suggests us how to build 

geometric solutions of the H-J multi-equation: 

Proposition Let A <Z C , A be Lagrangian and C = n'^^^H~^{0) coisotropic. Then 
the Hamiltonian vector fields Xjj^, a—1, d, are tangent to A. 

Proof. If V e T^A ^ V e T^C ^ v e n'^^^kei dHa{x), that is dHa{x)v = 0, Va = 
It holds that a{X^^,v) = —dHaV = 0, that is, the fields Xj^ are skew- 
orthogonal to A, Xjj^{x) G (Tj-A)-*- = Ta-A, where the last equality holds since A is 
Lagrangian. □ 

• Multi- valued Variational Solutions. The Liouville 1-form of T*{N x W^) is 

n d 
e = ^Pjdx^ + ^Tadt'' 
j=l a=l 

The restriction (pull-back) of 9 on the Lagrangian submanifolds gives closed 1-forms, 
indeed, by denoting j the inclusion map j : A^ T*{N x 



= (7|a = fa = j*d0 = dj*0 = d{0\A). 

Let / : A'^ — > M be the initial data for the multi-equation (Al), then a primitive 
function of (on A, parametrized by x, i^, . . . , i'^)) is given by 

P n d 

Six, t\ f") = fix) + / , J^P^dx^ - E 

z = (X, 0; df ix) , (0, X, df (x))) e T*iN x 
For small t^, . . . , i*^, the x-components of . . . . . $*''(2;), i.e. 

xix, t) = pr^vr^xR'* ^'\z), 
admits inverse: x = x(^)^)- such a (scarcely meaningful) case, the function 

Six,t) := Sixix,t),t) 
represents the classic solution to the Cauchy problem. 
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F Appendix: A short account on the develop- 
ments of the theory of the multi-equations of 
Hamilton- Jacobi 



After a pioneering paper by Tulczyjew [Tulczyjew , the study Hamilton- Jacobi prob- 
lems in general co-isotropic submanifolds of co-dimension greater than one inside 
T*Q, that is, extending the standard case ^ + H{t,x, ^) = 0, was further devel- 
oped by Benenti and Tulczyjew in Benenti- Tulczyjew] and then in [Benentij . where, 
among other things, in this last paper first it was considered generating functions 
with finite auxiliary parameters for Lagrangian submanifolds of T*Q x T*Q rep- 
resenting symplectic relations (canonical transformations). Examples of this new 
framework are the integrable Dirac systems reconsidered by [Lichnerowiczj and 



Menzio- Tulczyjew] . More recently, new examples of H-J multi-equations arose from 
economics [Rochet] . one can see the bibliography in [Barles-Tourin] . The use of 
symplectic topology and the notion of variational solution for the H-J equation have 
been introduced by Chaperon and Sikorav, and then developed in [Viterbo^ , where, 
in particular, the uniqueness of such a solution is deduced by the essential global 
uniqueness of the generating functions proved in [Viterbo T] . We recall that these 
variational solutions coincide with the viscosity solutions in the case of p-convex 
Hamiltonians [Zhukovskayaj , but it is not true in general case, lacking a (expected) 
Markov condition (cf. |Viterbo"2] . Viterbo-Ottolenghi] ) . 
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